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ABSTRACT 



The dimensionality of or i gi ha[ th i hk i hg is investigated using 
measures designed to control _* or ideational 
fluency/originality confounding and for task ambiguity. Subjects 
were 315 gifted 4th-<Sth graders. Resu 1 ts i ndi cated that original. <, 
thinking was conceptually distinct from intelligence. However,' ^ 
evidence for a general originality factor was mixed. Theoretical 
and methodol ogi cal implications are discussed. 
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Despite the multitude of studies in the area of original 
thinking, little attention has been given to the psyqhbmetr.i 
properties of orignality measures. This is surprising in I i gh * 
o-f the -Fact that many originality measures appear to require 
pot eh t j all I y dif f ^reh t men tal sk i 1 1 <2ri For ex amp 1 e, some measure* 
regui re subjec tyif to generate unusual uses for objects (Torrance, 
1974; Guilford^ 1962; Wallach & Kogan , 1965), some require 
subjects to /specu late oh how common objects might be improved 
(Torrance , / 1974) , and some require subjects to generate 
consequences to hypothetical situations (Torrance , 1974; 
Suit -ford, / 1962). An important issue is the degree td which 
performance on these tasks i h ter corr el a te If substantia^ 
correl anions between the tasks exist , then there is justification 
-for an/ or iginal i ty construct. Hctoever , if correlations between 
the Paribus tasks are low, then the use o-f th£ originality 
construct is less justified. In terms o-f Campbell and Fi ske' s 
(1959) classic paradigm -For establishing construct validity, 
different measures b-F the same construct should have conver gen t 
va 1 i di ty . 

Since multiple measures o-f or i gi nal it y have been ihcluded in 
dozens o-f studies, it would seem tha^ there is presently ample 
evidence as to whether or not originality measures have 
convergent validity. Un-f or tunatel y , this is not the case. Two 
major .problems prevent researchers from making valid 
generalizations abbUt the or i gi nal i ty construct. First, there is 
the criticism that contemporary measures of original ity_ are 
contaminated by a strong fluency component. (Fluency is defined 
as the number of responses given oh an or i gi hal i t>> task . ) Both 
Hocevar and Hi chael ( i979) and CI ar k and Mirels (1978) have made 
this criticism and suggest that fluency and originality are 
confounded due to the additive nature of the scoring formula used 
in brigtlality tests. Specifically, exami ne'e* who , give more 
responses get higher originality scores as a* result of their 
fluency i not their originality. 

Evidence for the confounding of fluency and originality stems 
from a variety of analytic techniques: 

a. Fl uency/original i ty correlations are extretnely high . . In a 

review of 39 reported correl at i ons between fluency and 

or iginal i ty, Hacevar ( 1979c) found that 82% exceeded .58 and that 
the average f 1 uency/or iginal ity. correl at i on was .69. Fur the^more, 
there is reason to bel ieve that pobl ished studies actual 1 y 
underestimate the f 1 uehcy/br i gi hal i ty correlation (see discussion 
bel ow) . 

b. Factor analytic studies do not yield separate fluency and 
originality factors (Child, 1978 ; Kazel skis, 1972 ; PI ass , Mi chael 
&_Michae1 , 1974; McKinney & Forman , 1977;. Yam*moto h Frengel , 
1966} Khat tab et al . . 1981). 

c. Mu 1 t i trai t-^fhU 1 timethbd analyses . do* hot support the 
discriminant validity of tfie f 1 Uehcy/br i gi nal i ty distinction 



< Harvey , Hbf fmeister , Coates* & White, 1979 5 Hocevar , 1979c). 

d. The rel i abi 1 i ty of or igihali ty tests drops to zero or hear 
zero when the effects of fluency are removed, thus suggesting 
that originality measures have little or no unique variance 
< Hocevar , 1979ab) . 

The above studies provide considerable support for the 
viewpoint that fluency and originality are riot empirically 
distinct. Despite the growing consensus on this point there is 
little agreement oh what should be* done« to alleviate this 
pr obi em . 

A second potential prcbiem with ccntemporairy measures oF 
originality is that examinees are not encouraged to use the 
ability that the tests purport to measure. More specifically, 
examinees are not instructed to be original when they are 
providing responses, or they are given ambiguous instructions. 
Thus individual differences may be a matter of task perception, 
rather than originality. In support of_ this viewpoint, 
Harrington ( 1975) administered the Al ternate Uses test to 50 male 
college students who were explicitly told to provide creative * 
(i.e.* original) uses for objects. A group of 55 contro[ 
subjects were given the same test under the tradi tional testing 
mode. That is, they were not told to provide creative responses. 
Results conclusively indicated that the scores obtained using 
qualitatively oriented instruction* <i.e.* be creative) were 
better predictors of a self-report criterion measure of 
creativi ty. Despi te the importance of Harrington's findings* the < 
modifications suggested by his research have not been adopted. 

Collectively* the above two measurement problems make the 
interpretation of prior correlations among originality measures 
ambiguous. In addition 1, prior research on the 

or igihal i ty/in tel 1 igehce issue is similarly difficult to V 
interpret^ While most researcher s presen t 1 y consider originality 
t as conceptually distinct from inteM igehce <e.g. , Torrance, 
1974, Wallach & Kogan , 1965), it is possible that this 
conclusion may have been inaccurately brought aboujt by the 
f 1 uency/or iginality confounding or the ambiguous nature of the 
instructions on con temporary or i gi nal i ty tasks. 

The major purpose of the. present study is to introduce a new 
way of. measuring originality and to investigate the 
dimensionality of original thinking using measures which are not 
subject, to' the shortcomings discussed above. Two innovations 
will be considered. Fi rst , exami hees are instructed to give only 
one response on each original i ty_ task rather than to give as many 
as possi bl e . This modification avoids the ideational 
f 1 uency/original i ty confounding discussed \ above. Second, 
examinees are specifically encouraged to be original as part of 
the instructions to the task. 
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Met.hodol ogy 



SiiJbiaul^ . Subjects were ^ 15 g,i ft ted and h ivgh Yy gifted, ana * 
talented students 4th, 5th, and 6th grade el ementary gifted 
school programs. Of the 315 subj ects, 134 were male, 13 ( 1 f emal e. 
71 were 4th graders, 99 5th graders,, and, 145 6th graders.' -j 
Siftedness was determined using the Starif ord-Bi net test*. 



JABasun&s. The tests cf or igina^ i ty used in this study 
incorporated the revi si oris of tradi t i brjial measures of original 
thinking discussed above. These measures included three tests, 
each with 18 items. In the first test a bnusaal Uses, subjects 
were instructed to generate an unusuVr use for each of 18 
ordinary objects. In the second test. Improvements, subjects 
generated an improvement -for each of 18 common objects. In the 

third test, Consequences, subjects generated a nonofevious 

consequence to each of 19 hypothetical si tuat ions. No time n imi t 
u)as put on the test i ^but the majority of the studen ts . needed 
approximately 38 minutes to complete the test. . 
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SxinnxixQ . The responses to al 1 items were subjectively scored 
on a ^our level originality seal e , and total scores were ^ 
computed by adding the ten items. Thus 'the range of possible 
scores was 18-38 . An original answer was defined a one that was 
both clever and unusual. A codebook of original responses was 
used by the scorer, A high degree of inter judge reliability 
(greater than .90) in several related studies (Bachelor et al . 
19S8; Urmari et al . i 1982) provide strong evidence for the 
eiiica,cy of using qualitative criteria in assessing originality. 

Resu 1 ts 

Table 1 gives the means and standard deviations for the three 
original i ty measures and for the Stanf ord-Binet IQ test. Ah 
initial . analysis was conducted to examine whether performance on 
the three or iginal i ty measures was related to grade level. Only 
the Consequences test cdrrel ated si gri i f i can t 1 y with orade level, 
r(313)=. 17, p < .85. h 

The i nten'correl at i ons among 38 items fr^om the original ity 
measures (18 each for U^es , Improvements, and Consequences) and 
the SB IQ measure were then f ac for analyzed using 'the LISREL 
confirmatory factor analysis procedure ( Joreskpg , 1969; Joreskog 
& Sorbom, 1981). Unlike traditional exploratory factor analytic 
techniques, confirmatory "actor analysis al 1 ows for the testing 

°* a specific factor analytic model . The model chosen for the 

present study is shown in Tab|e 2. Each item for the Uses test is 
restricted to load on Factor one (Uses); each item from the 

Improvements test . is restricted to load on Factor 2 ( 

(Improvements) ; and each item from the Consequences test is h 
restricted to load on Factor 3 (Consequences). The Stanf ord-Binet 
10 test defines the fourth factor- intelligence. As shown in s 
Table 2, the CFA loadings generally support the hypothesized ; \ 
model in that each of the loadings is positive and significant. 
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Farther support for the hypbthesi zejfi^nbdel s obtained from the 
item/factor correlations (hot showW*. in all causes items 
correlated highest with the factor that, they pqrported to 
measure. $ - . 4 

'. Tab[e 3 shows the -factor rel i abi 1 i t i es a and factor 

in tercorrel ati ons. As one would expect from the CFA loadings each 
of tfje or iginal i ty measures if rel iabl e, .Factor i n tercorr el at i ohs 
are also estimated by the confirmatory factor analysis. These are 

given above the diagonal in Table 3. Thes correlations are 

corrected for measurement error. For comparison purposes, the 
uncorrected correl at ions < i . e ., Pear son PM correlations) are also 
given in Table 3 (below the diagonal). Regardless of which set of 
correlations one considers, the correlations provide strong 
evidence for three conceptually distinct originality factors 
<*n i c n co usxl correlate with iritelli geri c e . 

Discussion 

. a . An initial purpose oflhe present investigation was to 
introduce a new procedure for testing or iginal i ty. The procedure 
differs from prior procedures in that subgec ts are speci f ical 1 y 
instructed to ±>e original and subjects are instructed to give a 
single "b^st" response. Results i ridi cated that the scores derived 
using these innovative procedures are reliable and have a well- 
defined factor structure. While this finding might appear to be 
somewhat mundane, it is an important and essential first step in 
the development of alternative measures ^of originality. 

Of greater theoretical interest are the correlations between 
the original i ty dimensions. In the introduction , i t was suggested 
that in? order to justify the "or iginal i ty" construe t , alternative 
indicators of the construct shbul d* cbrrel ate. In this study, one 
of^ the indicators < Cohsequences) clearly was independent of the 
another indicator < Improvemen ts) and only moderately correlated 
with the third indicator <Uses)^ Given this, one can conclude 
that the ability to generate remote consequences has little in 
common with the the ability to generate use* for objects and the 
ability to generate improvements for objects. When? one cbrisi ders 
that the Uses and Improvemen ts tests both tap the ability to 
focus on high quality answers while the Consequences tesV taps 
the ability to generate remote associations without qualitative 
reflection, the 1 ack ; of correlation is intuitively reasonable. 
The practical , implication of this finding is that- scores on the 
Consequences test should not be«combihed with scores oh the other 
two measures. 



The moderate correlation between the Uses and Improvements test 
<r=.487^ does suggest that these two measures have some variance 
in common, and perhaps one , can sum these two measures into a 
single original i ty indicator . Never thel ess * it is important to 
point out that much more research is needed be-fore the scientific 
usefulness of such an or i ginal i ty c^omposi te measure is justified. 
A useful f irst step woul d be to develop several more indicators 
of originality that would be expected to ^correlate with the 
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present indica tors- < i • e. , Uses and Improvements).. Then these 
indicators would need to be administered along with established 
indicators, of closely related abiU ties. Two 1 iKely candidates, 
for the Hatter category are ideational fl aehcy and verbal 
intelligence. In the Writ that a ijonfi rmatory factor analysis of 
such a battery yields a distinct originality factor , researchers 
would be justified in giving such a battery of originality tests 
further attention . 

A reasonabl e question is whether the results of the_ present 
study are an artifact of the selective sample. The mean 
intelligence test score of the sample is extremely high (mean IQ 
145 vs 189 for a national sample), and there is reduced 
variation on th§ IQ measure <SD=11.2vs \6.Q in _ _f_ national 
i?:moie>.. Perhaps this restriction of r*nge can exp[ ai n the [ow 
correlations between intel 1 igence and the original i ty measures. 
Nevertheless, i t i s impdr tan t to point out there was 

considerable variation on the intelligence measur^. ^Furthermore, 
the selective sample probably had a smaller influence on the 
correlations between the original ity measures because the sample 
was not selected Using performance on originality tasks as a 
criteria. 

The above findings and caveats ridtwi thstandi ng , a major 
purpose of the present' investigation was to introduce a new 
technique for controlling the fluency/originality confounding. In 
light of this purpose, it is important to discuss sc*ne 
alternative - procedures [_ for controlling for the 

fl.uency/or iginal i ty confounding. ; One such procedure was 
originally introduced by Nal 1 ach \ Kogan < 1963) , and has been 
used by several contemporary researjhers <e.g. Milgram^ 1983; 
Richards, 1988; Hattie, 1988). In the Nallach and Kogan 
procedure originality scores^ are computed by counting the number 
of ori>gina[ responses^ and ideational fluency scores are computed 
by subtracting the number of original responses from the total 
number of responses. While this prdcedure^bes attenuate the 
fluency/originality correl at i on , i ts application does not warrant 
Uncritical acceptance. First, the attenuation of the 
f 1 uency/or iginal i ty correl at'ion in such studies is something of 
an illusion because a less reliable measure of fluency < because 
it is based on a difference fcore) is analyzed. The situation is 
further complicated by the fact that the fluency/original i ty 
correlation is biased downward because of the natural tendency 
for subtrahend < i .ej originality) to be negatively correlated 
with a difference scdre <i.e., fluency). Finally, even i,f -one 
ignores these- potential^ Diases, not counting original responses 
in a fluency count is difficult to rationalize^ conceptually. 

A second approach * to controlling for ideational fluency has 
been introduced by CI arK & Mirels (1978). Under the CI ark/Mirel s 
system originality scores are computed by scoring original i ty 
f^om the first three responses, thereby eliminating the advantage 
normally given to subjects who have given a large number of 
responses. Conceptual 1 y, there are probl ems with this approach in 
tl^at it seems somewhat arbitrary to penalize respondants who put 



■- . 1 ■ ■■' . 

their best responses at the end; b? their*1ist* - x Indeed^ there is 
even evidence that earlier Responses on original i ty tests v are 
generally less original I ; .Another cr it i cj sm q-f the £1 ark/Mi^e]s 
formul ation was raised by Speedie", Asher , 2* Tref-finger < i?7i> who 
Hfpint out that the "positive" ejects o-f Clark and Mirels ar£ 
most 1 y due' to lowered reliabilities, thus making the correction 
more illUsory than real.; S 

Hhile there are problems with bbth the Wal 1 a<ch/Kogan and the 
GJ atrk/Mi rel s procedures for controlling -for -fluency and 
or i gi nal i ty , there are al so advan tages to their procedure^ 

to be measured 
do not require 

choose a " best 
will prove to be 
r ec ommen ded in the 
a-f ter much -fur ther 



First, they al 1 ow -f 1 uency and or igi nal i ty 
simu 1 taheousl y . Fur thermor e , their procedures 
subj ec t ' s to eval Uate th^i r own responses < i . * . , 
Whether one or bb th of these proc edur e 
i or interior) to the procedures 
i hves t i gat i bh can on 1 y be dec i ded 



answer) . 
super i or 
presen t 
research 



In the meantime, the potential merit and prbbl ems with 
each procedure deserve to be care-ful l y considered by researchers 
who want to investigate the -fluency/originality construe t < s) . 



ERIC 



. -1 



• ' J ■ . 

References 

Bachelor, P. , Hocevar , D., Bachelor, B., & Hocevar , S.P,.a nflui 
fprhni qiig f g C moa<;iiri ng oc±gxga±±±g in S=2 year bJLd cn.LLdc.fia. 
Paper presented at NCME , 1981 . 

efii ,a, D. ^iui* « 4^-*^,= N«w York : H6M, 

1970-. ; V; . - ' ..• ■ 

Clark, P. Mirels, H. Fluency as a pervasive element in the 
measurement of creativity. Joucpal q£ EduzZllnaal Mpasu cgmanl , 
1970, 2, 83-86. 

Cr on bach , L.J. Coefficient alpha and the- i n tirnai structure 6? 
tVsts. ^yhftfcmft-tcilia * 1951, ii, 297-334. ' 

Harvey, 0. J. , Hof fmeister , 'O.K. , Coates, Q. , lc Nhite, B.J. A 
partial evaluation of Torrance's tests of creativity. Ampr i^an 
FHi,r^inn a i gfisgAnchUTnnrna 1 , 1970, 2, 359-372. 

Hkt tie, J. Should creativity tests be admi h i stered under test 1 i ke 
conditions?. An empirical stu^'of three alternative conditions. 
■ Iq urn ^i o£ nn^v Esychnl opy , 22, 87- i 93. 

^ _ _ _ __ __ 

Hocevar, D. The u,n j dlmensi onal nature of creative thinking in 
fifth 'grade chi 1 dren . 4 ffirFhfl Sipdy JDupnal, 1979, 32, 273-277. 

Hocevar, D. Ideational -fluency as a confounding factor in the 
measuremerf t _ of or i gi nal i ty . Journ a l a£ FHHr*H final . B^yc hn l o q v , 
1979, 2J. S 191-196 : * 

Hocevar, D. MhI h frii t-miil tim^thnd anal v<ii <=» tf£ ±es±3 n£ r li vprgp nl 
iiiokiog. Paper preseh ted__at the Conference of the Western 
Psychological Association, 1979. 

Hocevar , D. & Michael , W. E-f-fects of scoring -formual on the 
discriminant validity o-f tests o-f divergent thinking. EHULSkti f i n a l 
and p^yrhningirai fctea snr pmen t , 1979, 32, 917-21". 

Kazelskis, R. The convergent, divergent, and factorial validify 
of the Torrance Figural_Test of Creativity. Snttthann Journal o£ 
FHnr.fionvi ftff^parrh, 1972, 6, 123-129. 

Khat tab, A., CI ark , F . f Hocevar , t>. & Benson, J~ £ rnnf i rmatnry 
^rfnr an^forhs o£ H£I undfin f ouc f-p^ti hij ca* rli fri nns . Paper 
presented at the Conference of the American Educational Research 
Assbcatidn, 1981. 

o -• * - - - • 

McKinney , J.' & Forman , S. Factor structure o-f the Wa 1 1 ach-Kog*o 
tests b? creativity and measures of intelligence and achievement.' 
P ^rhnl n 0 y +rt ±ft*> ^rhnnU. 1977, 14, 41-44. - - 

if 

Mi 1 gj am, R. Val idatio.n o-f ideational -fluency measures o-f original^ 
thinkiog in children; dauca^L n£ EduiLa±xonal Bsy rhn l ngy , 1983, 
25, 419-624.- v " A 



> 



ERIC 



Mi Ingram, Ri, Mil gram, N . Roseribi bom * G . , & RabRiri* L. Quantity 
and quality dt creative thinking in children arid adolescents. 
Chi iri Da^glbpmanl, 1973, 42, 335-388. 



Nunnal 1 y , J . P%yzhrme tr is Iluesny' New -York, McGraw-Hill, 1978. 

PI ass, H . , Michael , J, , 5c Michael, N. The -factorial yal idi ty, of 

the Torrance Tests Creative Thinking for a sample of 111 

sixth-grade- chi 1 dren . Ertuc-a H nhal and Psyrhnl hgi ra 1 Mpa^urpmprit ? 

1974, 34, 413-414. , 

Richards, R. A comparison o-f sel ected Guilford and Wallach Kogari 
Thinking creative tests in conjunction with measures ni 
i n t a 1 I i geri c e . Jour ha 1. o± C^^a±i^£ B^hai-atir. , 1 979 , JLfll » 4*3 , 15 1 - 

-io^ . ; ----- 

Speedier Si, Asher - 9 J. & Treffiriger, D. Comment on "Fluency as a 
pervasive element in the measurement of creativity" ,Jsucnal o£ 
Frlnrati nnal Mpa^nrpmpn t , 1971, S, 125-26. 

Torrance, E.P. Xosjrance Te<yt_5 jq£ Cffffa t i ve Th i nki ng : Nnrms- 
±BnhDi,cal manual . Lexington, MA: Gi nn ic Company, 1974. 

Urman ,H. , Ad1 er , P. , & Hocevar , D. Ef f pets o£ variati nns and 

i n^ f r ii r - f i nnc and *rr*r> in/j rri tori a on mfiaSlir iffllPn t Of flC i Q j h a 1 

itinking. Paper preseri ted at the 1982 Confer ence o? the Amer i can 
Educational Research Association, 1982N 

Wallach, M.A. & Kogan, N. Morten p£ Ibi . nki . ng ±n young _ s&± 1 drpn : 
S siiLdy n£ th** ^r^ H,Jj ty-infpi l igenre rji sit i nr t i nn . New .York : 
Holt, Ririehart & WirisJbbri, 1965. 

Yamamdto, K . & Prerigel ^ B • An exploratory component analysis of 
the Minnesota Tests o? Creative Thinking. Hal i f orhia Journ a l , oi 
FfiruattnTtat Bp^ear.ch, 1966, 12, 228-229. , 



r 



io 



^ Table 1 

Means arid standard devi at i ohs 

Test Mean SD 

Uses 1'? . 96 \ 3 .3? 

Impr dvemeh t s 1 17 . 33 o . 13 

Consequences 13 • 85 3 . 63 

SB IQ 146..88 11.1? 
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Table 2 



Fac *o*^ 1 oadi ngs 

a 





i 


"3 


3 


A 














;379 


.808 


. 00d 


.888 


U2 


.558 


.008 


.888 


.080 


U3 


.421 


.088 


.000 


;888~ 


U4 


.483 


.808 


.000 


. 000 


U5 


.587 


.0 80 


. 000 


.000 


IJ.5 


. 563 


.993 


. 99-0 


.990 


y? 


.427 




. g g 0 


. 3 0 @ 


U8 


i . 339 


.080 


.000 


.008 


U9 


.535 


;088 


.880 


.00 0 


U10 


.439 


.880 


.000 


.000 


I 1 


.000 


.613 


.000 


.80? 


12 


. 000 


.697 


.000 


.000 


13 - 


.000 


.679 


.000 


.000 


14 


.000 


.693 


.000 


.000 


I 5 


< 808 


.594 ; 


.000 


.000 


16 


.080 


.455 


.000 


.000 


17 


- .088 


.573 


.880 


.080 


18 


.888 


;567 


.080 


.880 


I 9 


.888 


.635 


.880 


.000 


110 


.800 


.50 1 


.888 


;000 


CI 


.888 


.000 


.449 


:000 


C2 


.080 


.000 


.479 


' .000 


£3 


.000 


.088 


.586 


.000 


C4 % 


.008 


.088 


.671 


.000 


es 


;000 


.000 


.468 


.000 


C6 ' 


.000 


.088 


.455 


• .088 


C7 - 


.880 


.088 


.543 


.888 


C8 


.000 


.888 - 


.539 


.808 


C? 


.000 


.888 


.758 


.888 


C18 


.000 


.000 


.662 


.888 


S8IQ 


.080 


.080 


.888 


.988 



- I 

a , 

The loading of the SB IQ test was set to .988 in order to 

identify the CFA model. This loading is the square root of the 

estimated reliability <. 819) . See the footnote to Table 3 for 
-further information on this estimate.] 
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Table 3 

a 

Factor Re I iabi Ti ties and Factor Intercorrelations 







1 


2 


3 


4 




Uses 


.740 


- .487 


.306 


-. 100 


• 


Improvements 


.379 


.350 


.084 


-.086 


3. 


Consequences 


. 229 


.091 


.320 


.078 


4. 


SB IQ 


-.'054 


-.079 


.044 


.310 



Note. Factor reliabilities (internal consistencies) are shown in 
the diagonal . The -factor correlations that are given above the 
diagonal are corrected for attenuation^ due to measur emen t error 
by CFA procedures. Factor intercorrelations below the diagonal 
are uncorrected Pearson product moment correlations. 

Internal consistency rel iabi 1 i t i es for Uses, Improvements, 
and Consequences are defined in the traditional fashion (i.e. 
Cronbach^ 1952) ; however, the estimate of^f^ror variation for 
each composite is based on the CFA findings^ The reliability for 
the SB was based on the published reliability in a national 
cross-sample (.9i)__after it has been corrected for the 
restricted range of IQ scores in this study (see NunnSlly, 1978, 
p. 241) . 
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